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Abstract 


A workshop with virtual consultation practice-based professional development model for self-regulated strategy 
development persuasive writing instruction was evaluated in a randomized controlled trial. Nineteen general education 
teachers and 564 Grade 5 and 6 students in 16 low-wealth rural schools participated. Following training, teachers provided 
instruction in their inclusive classrooms. Results indicated that students receiving instruction improved in the number 
of persuasive elements and words written when compared with students in the control group. Differences in element 
type were evaluated with largest effects noted for reasons and explanations. Student group differences were noted with 
nonstruggling students having greater gains than struggling students. 
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Forty-three percent of school districts in the United States 
are located in rural areas, serving approximately 20% of 
all public school students (Johnson, Showalter, Klein, & 
Lester, 2014). Like many schools in the United States, 
tural schools are challenged with teacher recruitment and 
retention difficulties, licensure issues, increasing student 
population diversity, rapidly changing economic struc- 
tures, and poverty (Mattingly, Carson, & Schaefer, 2014). 
Furthermore, students in rural schools are noted to have 
lower academic success than peers from metropolitan 
areas (Rojewski, 1999). On the 2012 National Assessment 
of Educational Progress (NAEP) test, only 32% and 33% 
of rural students performed at or above the Proficient 
level in reading in Grades 4 and 8, respectively (National 
Center for Education Statistics, 2013). Results for the 
2011 NAEP writing assessment were weaker; only 24% 
of Grade 8 and 12 rural students performed at or above 
the Proficient level (National Center for Education 
Statistics, 2012). To improve rural student outcomes, pro- 
viding professional development for teachers is an ongo- 
ing research priority (Brendle, 2015) and is the focus of 
our intervention study. 

Given poor student outcomes in writing, developing effec- 
tive professional development for writing instruction is 
timely. However, current methods of in-person professional 


development are generally not feasible for rural teachers. 
Interfering factors include a lack of professional develop- 
ment resources, geographic isolation, and unavailability of 
substitute teachers for release time. In light of these chal- 
lenges, Seltzer and Himley (1995) recommended that profes- 
sional development session organizers in rural school systems 
(a) invite school teams (e.g., teachers, specialists, and princi- 
pals) to participate, (b) promote ownership of the profes- 
sional development agenda, (c) plan for ongoing technical 
assistance, (d) make gradual changes, and (e) focus on teach- 
ing and learning strategies that foster meaningful connec- 
tions. The current study, therefore, was situated in a model of 
change dependent on these factors and on one well-estab- 
lished research-based intervention and professional develop- 
ment model, practice-based professional development for 
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self-regulated strategy development (Harris, Graham, & 
Mason, 2003). 


Writing Instruction 


Standards initiatives, such as the U.S. Common Core State 
Standards (Common Core State Standards Initiative 
[CCSSI], 2012), for written expression require a high level 
of writing skill. Graham (2006) noted that strategy instruc- 
tion has been documented as effective in improving the 
number of elements written, with an effect size (ES) of 1.15 
for group comparison studies and a percentage of nonover- 
lapping data (PND) of 95% for single-case studies. 
Additional seminal literature reviews and meta-analyses 
have documented the effectiveness of explicit strategy 
instruction for improving writing (e.g., Graham, McKeown, 
Kiuhara, & Harris, 2012; Graham & Perin, 2007). 


Self-Regulated Strategy Development (SRSD) 


SRSD instruction promotes independent use of task-specific 
writing strategies by teaching students cognitive and self- 
regulation strategies in tandem so they can better understand 
and regulate the writing process. SRSD instruction is situated 
within an iterative writing process model, as described by 
Flower and Hayes (1980), and within a sociocognitive model 
of learning (e.g., Vygotsky, 1986). In SRSD, students are 
active participants in the learning process and student effort 
is acknowledged and rewarded (Harris et al., 2012). Six scaf- 
folded instructional stages facilitate the student’s mastery of 
strategy use: develop background knowledge, discuss it, 
model it, memorize it, use guided practice, and perform inde- 
pendent practice (Harris, Graham, Mason, & Friedlander, 
2008). Students’ self-regulation of strategy use is supported 
by teaching students to set goals, self-monitor, self-instruct, 
and self-reinforce (Harris et al., 2012). Graham and Perin 
(2007) noted that SRSD significantly improves the structure 
of the writing of students in Grades 4 through 12 when com- 
pared with other types of strategy instruction and control con- 
ditions. Similar findings were noted in Mason and Graham’s 
(2008) review of writing instruction for Grade 4 through 12 
students with learning disabilities; SRSD instruction resulted 
in large gains in writing quality when compared with that of 
students in a business-as-usual control group (ES = 1.26— 
1.35) and in a separate review documenting improved writ- 
ing skills for students with emotional and behavioral disorders 
(McKeown, Fitzpatrick, & Sandmel, 2014). 

Two SRSD studies are particularly relevant for the 
instructional delivery as selected for the current study. Each 
study included four to five lessons focused on teaching stu- 
dents to write a short paper response, a “quick write.” In a 
quasi-experimental group study, Mason, Kubina, Kostewicz, 
Mong Cramer, and Datchuk (2013) investigated the effects 
of SRSD supplemental instruction, delivered by a graduate 
assistant, on the persuasive writing of 23 low-achieving 


urban Grade 7 and 8 students with and without disabilities. 
Students in treatment increased persuasive writing perfor- 
mance as indicated by large effect sizes (ES = 1.38 for num- 
ber of parts and ES = 1.49 for organization quality) when 
compared with a comparison group of average-achieving 
peers. In the second study, SRSD for planning and writing 
an informative paper was evaluated in a single-case multi- 
ple-baseline study across four Grade 6 inclusive science 
classrooms in a suburban school (Benedek-Wood, Mason, 
Wood, Hoffman, & MacGuire, 2014). Results indicated the 
78 students’ performance in writing quality and number of 
words written improved with large PND effects. 


Practice-Based Professional Development (PBPD) for 
SRSD 


PBPD for SRSD writing instruction specifies eight critical 
components for professional development in writing 
instruction: (a) the value of written expression, (b) proce- 
dures for developing written expression, (c) evidence-based 
principles for instruction and assessment of written expres- 
sion, (d) procedures for differentiation, (e) opportunities for 
scaffolded practice in teaching, (f) procedures for sustain- 
ability, (g) procedures for in-school and district leadership, 
and (h) presentation of the feasibility of the model (Harris 
et al., 2012). Two foundational studies informed our PBPD 
design (Harris, Graham, & Adkins, 2015; Harris et al., 
2012). In a randomized controlled trial study, Harris et al. 
(2015) examined the effects of PBPD for SRSD small- 
group instruction with Grade 2 teachers in suburban schools. 
PBPD was delivered for 12 to 14 hr spread across 2 days in 
the teachers’ schools. Results indicated large gains in story 
quality and number of elements at posttest and maintenance 
(ES = 0.89-1.65). In the second randomized controlled trial 
(Harris et al., 2012), results were replicated for whole-class 
instruction with Grade 2 and 3 teachers in three schools. 
After SRSD, students increased the number of elements in 
their stories (ES = 1.82) and opinion essays (ES = 2.02). 


Current Study 


The current study for Grade 5 and 6 students differed from 
prior PBPD for SRSD research in four significant ways: 


1. PBPD was provided across multiple states and geo- 
graphic areas in low-wealth schools. 

2. PBPD time was reduced to | day and was not con- 
ducted in teachers’ schools. 

3. Ongoing support was 
consultation. 

4. Teachers’ instructional delivery was reduced to five 
45-min lessons. 


provided via _ virtual 


Premises for effective professional development, as 
described by Ball and Cohen (1999), Desimone (2011), 
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and Borko (2004), were adopted. For example, to address 
barriers in rural schools, we invited school teams to a cen- 
tral location in their state to participate in PBPD during the 
summer months. A team-based approach with teachers and 
administrators from the same school collectively partici- 
pating was implemented (Borko, 2004). In-person PBPD 
and the teachers’ instructional manual used in the current 
study embedded the eight components from the Harris 
et al. (2012) model (see PBPD in the “Method” section). 

Given a reduced amount of time for in-person professional 
development and the inability to support teachers in their 
classrooms, we extended training and support by including 
virtual consultation. This was critical, as teachers who partici- 
pate in professional development activities with no follow-up 
support are unlikely to implement a new practice successfully 
(Cornett & Knight, 2009). Virtual learning has been docu- 
mented to be as effective as in-person professional develop- 
ment for improving teacher learning (Fisher, Schumaker, 
Culbertson, & Deshler, 2010; Mason et al., 2013). 

We selected one genre, persuasive writing, for the focus 
of the current study. Persuasive writing is a particularly chal- 
lenging form of written expression and one that is not well 
developed until late elementary school (Nippold, Ward- 
Lonergan, & Fanning, 2005). Two writing strategies were 
selected as the focus for SRSD instruction (Harris et al., 
2008). The first strategy, POW, is a general 3-step planning 
strategy: (a) Pick an idea or side of a topic, (b) Organize 
ideas by planning with notes, and (c) Write and say more by 
modifying and improving the original plan. The second 
strategy, TREE, helps students formulate basic elements of 
persuasion: (a) write a convincing Topic sentence, (b) write 
at least three Reasons why you believe the topic sentence, 
(c) write Explanations to support each reason, and (d) wrap 
it up with a good Ending sentence. The effectiveness of 
SRSD for POW + TREE in persuasive writing was first 
established in randomized controlled trial experimental 
studies in elementary settings with struggling writers (e.g., 
Graham, Harris, & Mason, 2005; Harris, Graham, & Mason, 
2006). Subsequently, SRSD for POW + TREE was validated 
in quasi-experimental (e.g., Mason et al., 2013) and multiple 
single-case design studies with Grade 6 through 8 students 
with and without learning disabilities, attention-deficit/ 
hyperactivity disorder, and emotional and behavioral disor- 
ders (see Mason & Kubina, 2011). 

In the current randomized controlled trial study, we 
examined the effects of our PBPD model for SRSD instruc- 
tion on students’ writing, as measured by elements written 
and on students’ writing skill-level differences. The follow- 
ing three research questions were proposed: 


Research Question 1: Did PBPD for SRSD persuasive 
writing instruction relate to elements of students’ persua- 
sive written expression as measured by the total number 
of reasons written, total number of explanations written, 
or the inclusion of a topic or an ending sentence? 


Research Question 2: What is the effect of teacher 
assignment to the PBPD for SRSD intervention on stu- 
dents’ total number of words written and total number of 
persuasive elements written? 

Research Question 3: Does the intervention effect on 
total number of persuasive elements written vary due to 
students’ writing ability? 


Method 


The feasibility of PBPD in the rural context was evaluated 
in the context of a larger development study, the Rural Early 
Adolescent Learning Program (Project REAL; see Farmer, 
Hall, Petrin, Hamm, & Dadisman, 2010; Hamm, 2017; 
Hamm et al., 2010), focused on developing teachers’ knowl- 
edge and skills for creating school environments that sup- 
port positive adjustment for students in early adolescent 
transition. Project REAL was conducted across seven states 
and 35 schools over a 2-year period. In the first year of the 
study, PBPD training and virtual consultation for SRSD 
persuasive writing instruction were provided to participat- 
ing schools’ general education teachers, classroom support 
specialists (e.g., special educators, speech-language pathol- 
ogists), and school administrators in a 2-day summer insti- 
tute. The first day of the institute focused on writing 
instruction; the second day focused on positive adjustment. 
After the 1-day training for SRSD, in the first weeks of the 
school year, but prior to the implementation of the positive 
adjustment intervention, teachers delivered writing assess- 
ments followed by SRSD for POW + TREE instruction in 
their general education classrooms. Virtual consultation 
support was provided during instructional periods. Pre- and 
postinstruction data collection on writing and all classroom 
SRSD instruction was concluded prior to implementation of 
procedures and data collection for the larger study. 


Participants and Setting 


Participants were 19 inclusive general education teachers 
and 564 Grade 5 and 6 students in 16 schools across four 
U.S. states located in the Midwest, Southeast, and 
Southwest. All 16 schools were eligible for U.S. Department 
of Education’s (2016) Rural and Low-Income School 
Program (RLISP) by having a locale code of 6, 7, or 8 and 
at least 20% of students from families living below the fed- 
eral poverty level. Ethnicity included (a) 100% Caucasian 
students in eight Midwestern schools, (b) 100% African 
American students in four Southeastern schools, (c) 100% 
Hispanic students in two Southwestern schools, and (d) 
60% Caucasian/40% Hispanic students in two Southwestern 
schools. 

Five hundred and ninety-two students provided consent, 
for a total of 58.65% female and 41.35% male students in 
Grades 5 (95.49%) and 6 (4.51%; see Table 1). Students 
with disabilities receiving special education services were 
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Table |. Student Demographic and Descriptive Data. 
Control group (n = 266) Intervention group (n = 326) 
Demographic/ 
descriptive data n % M SD n % M SD 
Gender 
Female 156 58.65 17] 52.45 
Male 110 41.35 155 47.55 
Grade 
Fifth 254 95.49 310 95.09 
Sixth 12 4.51 16 4.9| 
Ability 
Struggling 48 18.05 47 14.42 
Not struggling 218 81.95 279 85.58 
Pretest total 
Words 266 87.26 40.22 326 92.14 48.24 
Elements 266 4.25 2.14 326 5.09%" 2.35 
Reasons 266 2.26 1.36 326 2.737 1.50 
Explanations 266 0.77 1.02 326 1.20%" 1.26 
Pretest % yes 
Topic 266 84.59 36.18 326 78.22* 41.34 
Ending 266 37.22 48.43 326 37.42 48.47 


*p < .05. ***p < 001. 


not excluded from the study; however, the decision was 
made to not identify or aggregate data into a single group of 
students identified as receiving special education services 
because (a) diagnosis categories vary from state to state 
(Hallahan et al., 2007) and (b) the focus of the study was on 
outcomes for persuasive writing, specifically for students 
identified as struggling and nonstruggling writers in the 
context of inclusive classroom instruction and assessment 
(see the “Assignment Procedures” section). The majority 
(80%) of the intervention teachers had more than 10 years 
of experience teaching; 40% with a master’s degree. Control 
group teachers’ averages were comparable (50% with 
greater than 10 years’ teaching experience and 44% with a 
master’s degree). All teachers were certified in their area/ 
grade level. 


Assignment Procedures 


Eight matched-paired schools were randomly assigned to 
one of two groups: SRSD instruction or business-as-usual 
control. Schools were matched on a series of demographic 
features, such as geographic location by state, size of stu- 
dent population, student achievement as determined by 
state testing data, and student poverty (i.e., free/reduced- 
price lunch status). The intervention was implemented at 
the school level; all teachers in each intervention school 
took part in PBPD. Current writing practice for control 
schools was not accounted for; therefore, control group 
instruction was considered a business-as-usual condition. 
Intervention materials were made available to the control 
schools at the end of the research project. 


We calculated students’ writing ability by examining the 
mean and standard deviation of total elements written (see 
the “Measures” section) at pretest. Standard deviation cut- 
points have been used in prior SRSD research to identify 
struggling and/or at-risk writers. For example, (a) two thirds 
SD below the mean on a standardized story writing assess- 
ment was used in Graham et al. (2005) and in Harris et al. 
(2006), and (b) 1.5 SD below the mean on a standardized 
fluency measure was used in Mason et al. (2013). In these 
studies, assessment for establishing student need for instruc- 
tion based on ability was directly related to type of instruc- 
tion (i.e., story writing or quick writing). In the current study, 
we used students’ persuasive writing at pretest to determine 
ability to write in this genre. Students scoring more than | SD 
below the mean were considered struggling (n = 95), whereas 
their peers were considered nonstruggling writers (n = 497). 


Intervention 


In the first state to receive PBPD training, the first author, an 
expert in SRSD research and training, delivered instruction. 
Prior to this session, the sixth author, a former teacher and 
school administrator, met with the first author for two days 
of training in the procedures. The first and sixth authors also 
developed all assessment and instructional procedures col- 
laboratively. In addition, the sixth author attended the first 
PBPD session and, after modeling, practice, and feedback 
from the first author, delivered instruction in the remaining 
three states. 

Critical elements of effective PBPD to support rural 
teachers (Borko, 2004; Desimone, 2011) and to support 
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writing instruction (Harris et al., 2012) are italicized in the 
section that follows. To actively engage with colleagues of 
similar need and to use a team-based approach with teach- 
ers and administrators from the same school participating 
in PD activities, in-person PBPD training and virtual con- 
sultation were provided to each school’s general education 
teachers, specialists, and administrators. Training included 
watching and critiquing videos while also actively engaging 
in assessment and lesson components (e.g., assessment data 
collection, stages of instruction, self-regulation procedures) 
through modeling practice, providing opportunities for 
teachers to engage in active learning and collaborate with 
others, and providing short-term opportunities for scaf- 
folded practice in teaching. The PBPD in-person session 
was subdivided into four learning phases: 


1. A 90-min presentation on information processing, 
cognition, and self-regulated learning, including 
information on how to support student learning in 
each of these processes (focus on content and how 
students learn content; standards for writing 
proficiency). 

2. A 60-min session on effective strategy instruction 
for writing, including the value of written expres- 
sion, procedures for developing written expression, 
and evidence-based principles for instruction and 
assessment of written expression (including scoring 
methods for persuasive elements). 

3. A 90-min session on SRSD for POW + TREE per- 
suasive writing, including procedures for differenti- 
ation, for developing opportunities for scaffolded 
practice in the long term, for sustainability, and for 
in-school and district leadership. 

4. A 60-min session for reviewing the researcher- 
developed writing manual that included all assess- 
ment and intervention schedules and procedures, 
and for addressing the feasibility of the model. In 
addition to the writing manual, teachers were given 
a short article to read (Harris et al., 2003) and the 
Harris et al. (2008) book, Powerful Writing 
Strategies for All Students. All materials from the 
PBPD and in the handbook were also posted on a 
private website for Project REAL investigators and 
instructors. 


In-person training was not designed to stand alone, but to 
set the stage for virtual consultation to support long-term 
active engagement, teaching and learning connections, and 
opportunities to practice and apply instruction in the class- 
room. Virtual consultation was considered a critical element 
in reinforcing and extending what was learned during in- 
person training (Desimone, 2011), especially for supporting 
teachers’ instruction for students with disabilities (Mason 
et al., 2013). The sixth author provided one-on-one video- 
consultation via Polycom in on-demand (i.e., as teachers 


needed) sessions and in two 90-min mandatory video-con- 
ferencing sessions. Both mandatory sessions included a 
review of each lesson plan instructional step that had been 
completed. The first consultation session was devoted to 
SRSD instruction implementation and occurred during each 
teacher’s instructional delivery period. This first consulta- 
tion focused on students’ ability in learning to use the strat- 
egy steps and the self-regulation procedures taught. For 
example, teachers were asked whether any student was fail- 
ing to memorize the strategy steps; if so, they were provided 
suggestions for facilitating memorization (e.g., flashcard 
practice). Students’ use of self-regulation was a large focus 
of the virtual consultation. Teachers were asked, for exam- 
ple, to report interesting student self-statements and to dis- 
cuss any negative self-statements needing to be addressed 
during instruction, and to report on the personal goals stu- 
dents established for their writing. The second mandatory 
session was a “touch-base” session prior to the first posttest. 
Again, the focus of this session was to ensure that all stu- 
dents were using the strategies and self-regulation proce- 
dures and to brainstorm solutions for any student struggling 
to write. In addition, procedures for collecting postinstruc- 
tion writing assessments were reviewed in the second 
session. 


SRSD instruction. Following PBPD, teachers implemented 
SRSD for POW + TREE as whole-class instruction. Student 
accommodations were provided as documented on students’ 
Individualized Education Program (IEP; for example, extra 
time, quiet table). Five 30-min lessons were taught. All six 
stages of strategy acquisition and four self-regulation pro- 
cedures (in italics below) in the SRSD instructional deliv- 
ery model were employed throughout the lessons. The 
POW + TREE strategy included eight elements (one topic 
sentence, three or more reasons, three or more explanations, 
and one ending sentence). See Harris et al. (2008) for full 
lesson plans. 


Lesson |. The students’ background knowledge for per- 
suasive writing and strategy use, and goals for writing better 
papers were established in the first lesson (Establish back- 
ground knowledge). The teacher reviewed key terminology 
(e.g., “persuasive,” “reason’’), and each strategy step was 
reviewed and described (Discuss it). An anchor/model per- 
suasive paper was evaluated for number of TREE elements. 
In closing the lesson, students were reminded of the goal: 
writing better persuasive papers using elements in TREE. 


Lesson 2. As a warm-up activity, in this lesson and 
all future lessons, the students used paired practiced 
memorization of POW + TREE strategy steps (Memorize it). 
The teacher then orally read a writing prompt and cogni- 
tively modeled (i.e., modeled by thinking aloud while using 
self-instruction to direct writing behavior) how to use each 
step of POW + TREE and the self-regulation procedures 
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for writing a persuasive paper through each writing process 
stage (Model it). After modeling, the teacher asked the stu- 
dents to write out personal se/f-instructions to use before, 
during, and after writing. Lesson 2, and all subsequent les- 
sons, concluded with the teacher delivering verbal praise and 
a reminder about Memorize it practice for the next lesson. 


Lesson 3. After paired Memorize it practice and discus- 
sion, student pairs collaboratively wrote a persuasive paper 
with POW + TREE (Support it). The students were given a 
blank graphic organizer, a transition word chart, their per- 
sonal self-instructions sheet, and a choice of two practice 
prompts. Students were encouraged to use personal self- 
instructions throughout the writing process. After writing, 
the students counted and graphed the number of response 
elements written. A teacher could repeat the lesson if 
needed for individual students; no teacher reported repeat- 
ing the lesson. 


Lesson 4. In this lesson, the students were asked to write 
a persuasive paper with POW + TREE, but without instruc- 
tional prompting materials. Teachers could repeat the les- 
son if needed for individual students; no teacher reported 
repeating the lesson. 


Lesson 5. In this lesson, the students independently 
planned and composed their papers. Students also counted 
and graphed the number of persuasive elements written. 


Instructional Treatment Fidelity 


Two steps were followed to verify treatment fidelity. First, to 
self-monitor performance in instructional delivery, teachers 
were asked to use a step-by-step check sheet for each lesson 
step. During virtual consultation, teachers were prompted to 
report on their instruction by including the steps completed 
and on any difficulties and any successes. All teacher partici- 
pants reported that lessons steps were followed and all stu- 
dents appeared to be learning the strategies. 


Measures 


Students’ written responses were used to evaluate the effects 
of PBPD on student outcomes. Assessment was conducted in 
the general education classroom; IEP accommodations were 
provided (e.g., extended time; quiet work space). Assessment 
data (student written persuasive papers) were collected prior 
to teacher-delivered SRSD instruction in the beginning of 
the school year (early fall; pretest), immediately following 
instruction (midfall; posttest), and in the late spring (mainte- 
nance). Training for delivering assessments was provided 
during in-person PBPD, and teachers were encouraged to use 
consultation as needed for any questions regarding proce- 
dures or accommodations. Prior to each assessment, teachers 


were given coded papers, that is, papers with the coded num- 
ber assigned to each student. Coded papers included one set 
of two writing prompts, randomly assigned from a five- 
prompt set. This randomization was completed, so at any 
given measurement occasion, each class would have five 
prompt sets equally distributed among students. This proce- 
dure controlled for prompt effect (prior knowledge, interest, 
etc.) and limited potential sharing of ideas among students. 

Teachers delivered all assessments by giving students 
their assigned paper containing the randomly assigned 
prompts and pencils, and by asking them to select one of the 
two prompts and to write a paper. As in prior SRSD research 
and practice, there was no time limit for writing the response 
(e.g., Harris et al., 2006). The number of persuasive ele- 
ments was considered the measure that most represented 
what was taught in SRSD persuasive writing instruction. 
Elements were calculated with a point serial scoring system 
(Scardamalia, Bereiter, & Goleman, 1982) for (a) topic sen- 
tence, (b) a count for each reason, (c) a count for each 
explanation, and (d) ending sentence. A score of 1 was 
awarded if the element was present. Given that students 
could write multiple reasons and explanations, there was no 
ceiling to the elements measure. 

Four advanced graduate student scorers rated all mea- 
sures. Papers were coded so scorers were blind to the pur- 
pose of the study, testing time, student, teacher, school, and 
condition. The first and second authors conducted a 2-hr 
scorer-training session for scoring elements that included 
(a) reviewing scoring rubrics for each measure, (b) review- 
ing and scoring example and nonexample sample papers, 
and (c) providing practice in scoring example and nonex- 
ample sample papers. During scoring training, scorers rated 
sample papers until they achieved 95% agreement over 10 
responses. Scorers then assigned scores independently. 
Thirty-three percent of each measure was scored twice. 
Reliability was established at 80% or better across each 
measure. Prior writing research has shown an acceptable 
reliability baseline range of 78% to 79% (Graham et al., 
2005; Harris et al., 2006). Disagreements in two scores 
were averaged. Number of words, often used to measure 
productivity and variability in written language (Nelson, 
Bahr, & Van Meter, 2004), was counted by four advanced 
graduate student scorers. Thirty-three percent of all papers 
were scored twice; reliability (agreements/total) was 99%. 


Analytic Steps 


Our first research question was focused on significant differ- 
ences in the total number of reasons and explanations between 
the control and intervention groups at posttest and mainte- 
nance, with additional focus on the percentage of students 
who included a topic sentence or ending sentence. We exam- 
ined significant differences between the two groups using 
multivariate analysis of covariance (MANCOVA) with 
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children nested within schools (Raudenbush & Bryk, 2002). 
The child’s gender (female = 0, male = 1), grade (Grade 5 = 
0, Grade 6 = 1), writing ability (struggling = 0, nonstruggling 
= 1), and pretest scores on the variables of interest served as 
covariates in the analysis, with intervention status as the 
grouping variable (control = 0, intervention = 1). Although a 
Satterthwaite approximation can be used to account for 
unequal sample sizes, as was the case between the control 
and intervention groups in our study, it can also produce inac- 
curate p values (McDonald, 2014). Therefore, to avoid the 
possibility of a false positive regarding intervention effec- 
tiveness, we did not use a Satterthwaite approximation. 

For our second research question regarding the total 
number of words and elements at posttest and maintenance, 
and possible differences between struggling and nonstrug- 
gling writers, we conducted multilevel model (MLM) anal- 
yses, accounting for nesting at the school level. Fixed 
effects included child gender, grade, writing ability, and 
group. Students’ pretest scores were included as a final 
covariate to establish a baseline for all students. Interaction 
effects by writing ability were estimated simultaneously 
with the same covariates as in the main effects models for 
outcomes at posttest and maintenance. 

There was no missingness on any of our predictor vari- 
ables; however, at posttest and maintenance, there was 
6.25% missingness and 16.39% missingness on our out- 
come measures, respectively. We accounted for missing 
data using the multiple imputation (m = 20) procedure 
(PROC MI) in SAS 9.3. Multiple imputation is an accept- 
able and recommended method when data are missing at 
random (Schafer & Graham, 2002). All control and out- 
come measures were used in the multiple imputation proce- 
dure. Continuous variables were mean-centered after 
imputation to aid in interpretability. 

For all research questions related to significant main 
effects and interaction effects, effect sizes for mean differ- 
ences were calculated with Cohen’s d= M — M,/ 6 dis 
Effect sizes were considered to be small ‘(.20), ie iam 
(.50), or large (.80), as suggested by Cohen (1992). 


Results 


Demographic and descriptive data for the 592 early adoles- 
cent students involved in this study are available in Table 1. 
A series of linear analyses with Tukey mean-differences 
comparisons and chi-square tests of independence revealed 
Statistically significant differences between control and 
intervention students on some pretest measures. Although 
there were no significant differences in the total number of 
words or the inclusion of an ending sentence, students in the 
intervention group scored significantly higher at pretest on 
total elements, t(590) =—4.48, p < .001; total reasons, t(590) 
= —3.96, p < .001; and total explanations, (590) = —4.54, 
p <.001. Students in the control group were more likely to 


include a topic sentence at pretest, y°(1, N = 592) = 3.87, 


p = .049. Students’ pretest scores were included in analysis 


to account for differences at pretest. There were no signifi- 
cant differences based on gender, grade, or ability. 


Effects for Students’ Persuasive Writing 
Elements 


Regarding our first research question, results from 
MANCOVA analyses (see Table 2) suggested a significant 
advantage for students in the intervention group versus the 
control group on total reasons, total explanations, inclusion 
of a topic sentence, and inclusion of an ending sentence, at 
both posttest and maintenance, controlling for pretest 
performance. 


Total reasons. A significant main effect for group, while 
controlling for pretest, gender, grade, and ability, was found 
for total reasons. At posttest, F(1, 540) = 74.30, p < .001, 
the effect size of 0.70 favored the intervention group. At 
maintenance, F(1, 480) = 42.02, p < .001, the effect size of 
0.61 favored the intervention group. 


Total explanations. A significant main effect for group, while 
controlling for pretest, gender, grade, and ability, was found 
for total explanations. At posttest, F(1, 540) = 78.55, p < 
.001, the effect size of 0.79 favored the intervention group. 
At maintenance, F(1, 480) = 45.80, p < .001, the effect size 
of 0.64 favored the intervention group. 


Topic sentence. A significant main effect for group, while 
controlling for pretest, gender, grade, and ability, was found 
for topic sentence. At posttest, F(1, 540) = 6.36, p = .012, 
the effect size of 0.21 favored the intervention group. At 
maintenance, F(1, 480) = 8.86, p = .003, the effect size of 
0.26 favored the intervention group. 


Ending sentence. A significant main effect for group, while 
controlling for pretest, gender, grade, and ability, was found 
for ending sentence. At posttest, F(1, 540) = 44.57, p< .001, 
the effect size of 0.59 favored the intervention group. At 
maintenance, F(1, 480) = 18.94, p < .001, the effect size of 
0.42 favored the intervention group. 


Effects on Total Words and Total Elements 


Regarding our second research question, results in Table 3 
suggest significant main effects with moderate to large effect 
sizes for group membership in favor of the intervention 
group on total words and total elements at both posttest and 
maintenance, controlling for pretest. 


Total words. At posttest, students’ pretest scores, gender, 
and grade were uniquely associated with their total number 
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Table 2. MANCOVA Results for Writing Elements at Posttest and Maintenance. 
Posttest scores Maintenance scores 
Control group Intervention group Control group Intervention group 
(n = 247) (n = 308) (n = 214) (n = 281) 
Writing element M SD M SD d M SD M SD d 
Total 
Reasons 2.16 1.17 2.947 1.06 0.70 2.21 1.16 2.9 | 1.14 0.61 
Explanations 1.02 1.13 2.047 1.42 0.79 0.70 1.01 1.477% 1.37 0.64 
Percentage “yes” 
Topic sentence 85.83 34.95 92.53* 26.33 0.21 = 81.31 39.08 90.39%* 29.52 0.26 
Ending sentence 43.32 49.65 71.437 45.25 0.59 42.06 49.49 62.63% 48.46 0.42 
Note. Bolded ds are significant effect sizes. MANCOVA = multivariate analysis of covariance. 
*p < .05. **p < 01. ***p < 001. 
Table 3. MLM Effects for Total Words and Total Elements (N = 592). 
Posttest Maintenance 
Effects/components B SE d B SE d 
Total words 
Fixed effects 
Pretest 0.37% 0.04 0.24 0.03 
Gender — 12.037 3.17 — 14.36" 3.04 
Grade 14.49* 7.06 -5.14 6.71 
Ability 742 4.24 6.69 3.96 
Group 20.73* 8.12 0.47 14.96* 7.64 0.38 
Variance components 
Level 2 Variation 271.40** 102.56 239.51* 93.82 
Level | Variation 1,19 1.36% 74.11 | ,038.85%* 68.19 
Total elements 
Pretest 0.227 0.05 0.14% 0.05 
Gender -0.75** 0.17 -0.59%* 0.16 
Grade 0.07 0.39 -0.56 0.40 
Ability -0.27 0.30 0.30 0.30 
Group 2.177% 0.40 0.90 1.757" 0.44 0.77 
Variance components 
Level 2 Variation 0.62* 0.25 0.78* 0.30 
Level | Variation 3.80** 0.23 3.27** 0.22 


Note. Bolded ds are significant effect sizes. MLM = multilevel model. 
*p < .05. **p < 01. ***p < 001. 


of words written. Students who scored higher at pretest, 
female students, and those in Grade 6 appeared to score 
higher on the total number of words written at posttest. In 
the presence of all covariates, our results demonstrated that 
students in the intervention group scored significantly 
higher at posttest on total words written (b = 20.73, p = 
.011, d=0.47). At maintenance, students’ pretest scores and 
gender were uniquely associated with their total number of 
words written. Two groups—students who scored higher at 
pretest and female students—appeared to score higher on 


the total number of words written at maintenance. In the 
presence of all covariates, our results demonstrated that stu- 
dents in the intervention group scored significantly higher 
at maintenance on total words written (b = 14.96, p = .046, 
d= 0.38). 


Total elements. At posttest, students’ pretest scores and gen- 
der were uniquely associated with their total number of ele- 
ments written. Two groups—students who scored higher at 
pretest and female students—appeared to score higher on 
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Table 4. Interaction Terms by Writing Ability for Total 
Elements (N = 592). 


Total elements 


Posttest Maintenance 
Interaction B SE B SE 
Group by Ability -0.07 0.47 0.83* 0.41 


Note. Covariates included pretest, gender, grade, ability, and group. 
*p < .05. 


o 


== Strugglers 
Non-strugglers 


ee 


Control 


Total elements at maintenance 


Intervention 


Figure I. Group by Ability interaction. 


the total number of elements written at posttest. In the pres- 
ence of all covariates, our results demonstrated that students 
in the intervention group scored significantly higher at post- 
test on total elements written (b = 2.17, p < .001, d= 0.90). 
At maintenance, students’ pretest scores and gender were 
uniquely associated with their total number of elements 
written. The same two groups—students who scored higher 
at pretest and female students—appeared to score higher on 
the total number of elements written at maintenance. In the 
presence of all covariates, our results demonstrated that stu- 
dents in the intervention group scored significantly higher 
at maintenance on total elements written (b = 1.75, p< .001, 
d=0.77). 


Effects by Writing Ability 


Regarding our third research question, analysis of modera- 
tion effects by writing ability with respect to the total num- 
ber of elements written at posttest and maintenance revealed 
a significant interaction at maintenance (b = 0.83, p = .045; 
see Table 4). The interaction between ability and interven- 
tion status is displayed in Figure 1. For struggling writers, 
analysis of the slope indicated the effect size (d = 0.57), 
although approaching significance, was ultimately not 
found to be significant (p = .070). For nonstruggling writ- 
ers, analysis of the slope indicated the effect was significant 
and positive (d = 0.84, p < .001). In comparing the scores 


for total elements at maintenance for struggling and non- 
struggling writers in the intervention group, a large effect 
size (d = 0.75) in favor of nonstruggling writers was 
detected. 


Discussion 


Writing is an important skill (CCSSI, 2012) and is a needed 
area for improvement in rural schools (National Center for 
Education Statistics, 2012). In 2011, only 33% of Grade 8 
and 12 students in the United States were proficient in writ- 
ing, whereas in rural schools, only 24% met proficiency 
(NAEP; National Center for Education Statistics, 2013). In 
the current study, an in-person and virtual consultation 
PBPD model for research-based writing instruction resulted 
in positive gains for both struggling and nonstruggling writ- 
ers in Grade 5 and 6 rural classrooms. Results favored stu- 
dents receiving SRSD instruction compared with students 
in the control group, with large effects for total number of 
elements written (ES = 0.90) and with small effects for the 
number of words written (ES = 0.47). In line with prior 
research, students improved in writing content with greater 
gains when compared with word count (Graham, 2006). 

As indicated by the number of elements and words writ- 
ten, the effectiveness of the intervention decreased over 
time once instruction was completed; however, significant 
differences maintained (ES = 0.77 for number of elements; 
ES = 0.38 for number of words). This result, unfortunately, 
is often found in intervention research and could be attenu- 
ated by booster sessions (Graham & Harris, 2003). 
Monitoring student progress, revisiting student goals, and 
supporting student writing through feedback and reinforce- 
ment over time, although noted in PBPD and the instruc- 
tional manual, were not explicitly embedded in procedures. 
To achieve long-term and strong effects, the virtual consul- 
tation model should have included additional required ses- 
sions to improve the researcher—teacher relationship, as 
suggested by Knight (2011). Although research has not yet 
established criteria for virtual consultation following inter- 
vention implementation, at least 20 hr of contact time spread 
over a semester has been suggested (Desimone, 2011). 

Analysis of individual components paralleled results 
noted in other studies with young adolescent students (e.g., 
Benedek-Wood et al., 2014; Mason et al., 2013.). Small but 
significant gains (ES = 0.21) in topic sentence writing indi- 
cated students’ skills in developing this sentence type 
needed improvement; less than for other persuasive ele- 
ments, however. In other words, many students had skills in 
developing topic sentences prior to instruction; 78.22% of 
treatment students and 84.59% of control students wrote 
effective topic sentences at pretest. The large gains for writ- 
ing reasons and explanations (ES = 0.70 and 0.79, respec- 
tively) and the moderate gains for writing an ending 
sentence (ES = 0.59) point to the areas in most need of 
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remediation and to the strength of SRSD instruction for 
Grade 5 and 6 students in rural schools. 

Our results also indicated significant differences in 
effects of SRSD instruction for struggling and nonstrug- 
gling writers. Analysis of moderation effects indicated 
insignificant effects for struggling learners (ES = 0.57) and 
significant large effects for nonstruggling learners (ES = 
0.84). When comparing the two groups, the intervention 
was moderately more effective for nonstruggling writers 
(ES = 0.75). Similar differences were noted by Benedek- 
Wood et al. (2014), who found that following SRSD instruc- 
tion, students with disabilities never reached the highest 
criterion level for organizational quality but 88% of 
responses from students without disabilities met the crite- 
rion. The differential effects based on writing ability were 
an important finding for two reasons. First, the positive 
findings for nonstruggling writers receiving SRSD instruc- 
tion in whole-class instruction supports the idea that 
research-based instruction is beneficial for all students, not 
just those who struggle to learn (Marzano, Pickering, & 
Pollock, 2001). In addition, the smaller growth seen for 
struggling writers indicates a potential need for more inten- 
sive intervention, such as would be provided in Tier II or 
Tier III supplemental instructional time in a response to 
intervention (RtI) model. The gains from supplemental and 
additional practice, especially for struggling learners, have 
been well established in prior research (Harris et al., 2006; 
Mason et al., 2013). 


Limitations 


Given the large geographic area and remote location of the 
tural schools in our study, treatment fidelity was limited 
and not as rigorous as in prior SRSD studies (Mason & 
Graham, 2008; Mason et al., 2013). Although access to 
broadband Internet is limited in many rural settings 
(Whitacre & Mills, 2010), effective methods for observa- 
tion through use of virtual audio and/or visual technology 
should be planned for research and PBPD consultation in 
rural settings. 

Although PBPD did address differentiation, our results 
indicated students who struggle with writing need addi- 
tional support, such as supplemental small-group instruc- 
tion, to make gains similar to those of their peers. We 
encourage teachers to carefully monitor students’ written 
expression progress throughout instruction and provide 
opportunities for practice. As schools move toward Rtl 
models for instructional delivery, our hope is that there will 
be more flexibility in providing all students with the time 
and resources needed to be successful in acquiring written 
expression skills. This extra time will be especially critical 
for students who are struggling writers, as it is clear from 
this study they may need extended instructional support to 
catch up to their peers. 


Implications for Rural Classrooms 


Our goal was to test the effects of SRSD for improving the 
persuasive writing performance of all students through 
whole-class instruction in the inclusive rural classroom. 
Both the professional development provided (i.e., 1-day 
workshop plus consultation) and the instructional delivery 
(i.e., five 45-min lessons) appear to be effective for meeting 
this goal. It should be noted, however, that professional 
development was provided to school teams, including 
administrative staff. Given the factors that can challenge 
teachers in rural schools (e.g., geographic location), it is 
essential that recommendations, such as team-based profes- 
sional development and ongoing support, are considered 
(Seltzer & Himley, 1995). In other words, providing mecha- 
nisms to support teachers in SRSD writing instruction is 
important. In addition, researchers have documented that 
when implementing SRSD, it is critical, especially for stu- 
dents who struggle the most with writing (e.g., students 
with disabilities), that teachers use all stages of SRSD 
instruction and all procedures to support students’ self-reg- 
ulation (Graham et al., 2012). Finally, information to sup- 
port the implementation of SRSD writing instruction is 
widely available to rural educators who want to learn more 
and has been included in an appendix at the end of the 
article. 


Appendix 


Resources for Self-Regulated Strategy 
Development Instruction 


Practitioner-based articles 

Harris, K. R., Graham. S., & Mason, L. (2003). Self-regulated 
strategy development in the classroom: Part of a balanced 
approach to writing instruction for students with disabilities. 
Focus on Exceptional Children, 35, 1-16. 

Mason, L. H., Benedek-Wood, E., & Valasa, L. (2009). Quick 
writing for students who struggle with writing. Journal of 
Adolescent and Adult Literacy, 53, 313-322. 

Sandmel, K., Brindle, M., Harris, K. R., Lane, K. L., Graham, 
S., Little, A., . . . Mathias, R. (2009). Making it work: 
Differentiating Tier 2 writing instruction with self-reg- 
ulated strategy development in tandem with schoolwide 
positive behavioral support for second graders. TEACHING 
Exceptional Children, 42, 22-33. 


Books with reproducible materials for teachers and students 

Harris, K. R., Graham, S., Mason, L. H., & Friedlander, B. (2008). 
Powerful writing strategies for all students. Baltimore, MD: 
Brookes. 

Mason, L. H., Reid, R., & Hagaman, J. (2012). Building com- 
prehension in adolescents: Powerful strategies for improv- 
ing reading and writing in content areas. Baltimore, MD: 
Brookes. 

Mason, L. H., Reid, R., & Hagaman, J. (2016). L’enseignement 
explicite de la lecture et de l’écriture: 40 legons pour hisser 
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les éléves vers la réussite. Quebec City, Canada: Cheneliere 
Education. 


Websites 

IRIS free, online interactive tutorials: 

http://iris. peabody. vanderbilt.edu/pow/chalcycle.htm 
http://iris.peabody.vanderbilt.edu/srs/chalcycle.htm 
http://iris.peabody.vanderbilt.edu/srs_spanish/chalcycle. 
htm 

Think SRSD (http://www.thinksrsd.com/) 
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